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Abstract 

We present a new result on uniform attractivity of the origin for nonlinear time-varying 
systems. Our theorem generalizes Matrosov's theorem which extends, in a certain manner, 
Krasovski-LaSalle invariance principle to the case of general nonlinear time-varying systems. 
We show the utility of our theorem by addressing a control problem of port interconnected 
driftless systems. The latter includes as special case, the control of chained-form nonholonomic 
systems which has been extensively studied in the literature. 



1 Introduction 

Many nonlinear control algorithms rely heavily on analysis tools that establish convergence to 
the origin for trajectories of a time-varying nonlinear system having a uniformly stable origin. For 
time-invariant problems, the typical analysis tool used is the Krasovski-LaSalle invariance principle. 
It is the key result that leads to the so-called Jurdjevic-Quinn control algorithm for open-loop 
stable nonlinear control systems. When the closed-loop is time-varying, one tool that is often 
used is Barbalat's Lemma [1^. In adaptive control, Barbalat's Lemma is frequently relied upon 
to establish convergence to zero of part of the state. Barbalat's Lemma has also been used to 
establish convergence to the origin for a class of nonholonomic systems controlled by smooth time- 
varying feedback. For time-varying systems, another tool that has been used, but more sparingly, 
is Matrosov's theorem [21 El- It was used e.g. in [3] to establish one of the first results on uniform 
global asymptotic stability (UGAS) of robot manipulators in closed loop with a tracking controller. 
It also appears in the context of adaptive control in and output feedback control in [U]. 

*This work is supported in part by a CNRS-NSF collaboration project and was partially done while the first two 
authors were visiting the CCEC at UCSB. It is also supported by the AFOSR under grant F49620-00-1-0106 and 
the NSF under grants ECS-9988813 and INT-9910030. 
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Matrosov's theorem first appeared in 2]. It pertains to the situation where one has a continu- 
ously different iable (C^) Lyapunov function that estabhshes uniform stabihty and also a auxil- 
iary function with appropriate properties. In particular, the auxiliary function should be bounded 
uniformly in time on bounded regions of the state space, and should have a "definitely nonzero" 
derivative on the set where a given, continuous, time-independent non-positive upper bound on the 
Lyapunov function's derivative vanishes. To illustrate how Matrosov's theorem works on tracking 
control problems it is worth looking at the example of tracking control of robots. 

Example 1 Let us consider the Lagrangian model of a rigid-joints robot (see e.g. jTj) 

D{q)q + C{q, q)q + g{q) = u 

where the inertia matrix D is positive definite for all g G M", -D — 2C is skew-symmetric and u G M" 
are control torques. The control problem is to make the robot follow a smooth reference trajectory 
q^{t) such that max{|g^,| , \q* \ , \q*\} < Pd- For this, we apply the control law (cf. 

u = D{q)q^ + q)q^ + g{q) - kpq - k^q 

where q '■= q — q*-, kp, k^ > 0. Now we would like to analyze the stability of the closed loop system, 
so we use the energy-based Lyapunov function 

V=^[fD{q)^ + kp\qf') 

to obtain that V = —k^ \ q\ < and hence, that the origin of the system is uniformly globally 
stable (UGS). From this equality, it is also fairly standard to invoke Barbalat's Lemma to conclude 
that q —>■ (see e.g. [8 ). Alternatively, we can use the auxiliary function W = q^ Dq which is 
uniformly bounded on compact sets of the state and whose total time derivative satisfies^ 

W < -kp \qf + III [dM III + kd \q\ + kciPd + |||) |g| ]=:Y. 

~ I 1 2 

Intuitively, since we know that g ^ we may think that Y —kp \q\ so roughly, if we wait 
long enough (and we can do that because the system is UGS) we will have that for large t, W{t) < 
—kp \q{t)f. In particular, q is square-integrable so invoking again Barbalat's Lemma one may accept 
that it should hold that g — as well. 

This idea can be made rigorous to actually prove UGAS via Matrosov's theorem: one needs to 
observe that Y is sign-definite (it is actually negative for all nonzero values of the state) on the 
set {V = 0} that is, on {g = 0, g G M"}. The argument at work here is roughly speaking that 
the sign-definiteness of Y and the fact that = on the set {V = 0} imply that the system's 
trajectories cannot remain trapped on the set {g = 0, g G M"} unless they go to zero. See [9| p. 
263] for a rigorous development on this idea and |3] for a rigorous analysis of this control system 
based on Matrosov's theorem. □ 

Thus, Matrosov's theorem can be regarded, to some extent, as an invariance principle for non- 
autonomous systems. There have been several interesting extensions of Matrosov's theorem over 
the years, mostly found in the work of jHl GDI and references therein. In ^Tj , the author considers a 
vector of auxiliary functions, while in ^2] the authors consider a family of (possibly uncountable) 
auxiliary functions. In both cases, the behavior of the auxiliary functions are referenced to the set 

^Using the facts that \D{q)\ < dM and \C{q,q)\ < kc \q\- Sec 7 for further details. 
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where the upper bound on the derivative of the Lyapunov function vanishes. In extensions 
are given that pertain to stabihty of sets and that allow locally Lipschitz Lyapunov and auxiliary 
functions. In 14 a simplified condition is given for checking that the auxiliary function has a 
sign-definite derivative. 

Most recently, in jT3j the authors have extended Matrosov's theorem to pertain to differential 
inclusions, at the same time addressing stability of sets, using locally Lipschitz auxiliary functions 
and weakening the requirements on the upper bound of the derivative of the Lyapunov function. 

1.1 Contributions of this paper 

In this paper we develop a version of Matrosov's theorem that uses a finite family of auxiliary 
functions to establish uniform convergence. For simplicity of exposition, we will limit our discussion 
to differential equations, uniform asymptotic stability of the origin, and a means of checking a sign- 
definiteness condition that is similar to what was used in Nevertheless, the results that we 
present here extend easily to more general settings (stability of sets, differential inclusions, e — 6 
characterizations of sign-definiteness, etc.) 

Since we use a finite family of auxiliary functions, it is natural to wonder about the comparison 
to the vector of auxiliary functions used in and the uncountable family of auxiliary functions 
used in P2]- The main difference is that, whereas in the above references the behavior of all of 
the auxiliary functions and their derivatives is referenced to the set where the upper bound on the 
derivative of the Lyapunov function vanishes, our auxiliary functions are ordered and the behavior 
of an auxiliary function and its derivative is referenced to the set where the upper bounds on the 
derivatives of all of the preceding auxiliary functions vanish. We assume uniform stability, rather 
than assuming that we have a Lyapunov function which establishes it, and then none of our auxiliary 
functions is assumed to be sign definite. 

Finally, we remark that the motivation to have a family of auxiliary functions as opposed to 
2 functions as in the case of the original Matrosov's theorem, should become clearer through the 
case-studies in control design that we will address: control of port-controlled driftless systems, and 
as a particular case, chained- form and "skew-symmetric" systems (see e.g. jElC^ respectively). To 
anticipate the development of these control applications we shall say that a non-obvious fundamental 
property of the mechanical system in Example Q that makes Matrosov's theorem work to prove 
UGAS is that the system has relative degree one from the passive output q. This property still 
holds for chained form systems of 3 states however, it is lost for higher-dimensional systems. While 
there seems to be no precise arithmetic correlation between the degree of the system and the number 
of functions needed, it shall become apparent from the case-studies, that it is natural to have a 
number of auxiliary functions which is directly related to the number of states in the chain of 
(nonlinear) integrators and therefore, to the relative degree of the system. 

Thus, we believe that the analysis tool that we are presenting may become an efficient tool to 
aid time- varying nonlinear control design, and may contribute to making the idea of using auxiliary 
functions for nonlinear systems, as introduced by Matrosov, a more versatile concept. 

The rest of the paper is organized as follows. For clarity of exposition, we present our results 
from the most particular to the most general: we start in Section |21 with the "simple" control 
problem of stabilizing a 3-states chained-form system. The way we solve the problem of analyzing 
the stability of this system in closed loop with previously reported control laws, will motivate the 
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sufficient conditions of our main Theorem. The latter is presented in Section El In Section 0] we 
present our main result in control design which covers chained-form systems as a particular case. 
The proof of our main theorem is presented in Section El and we conclude with some remarks in 
Section IHl 



1.2 Mathematical preliminaries 

We use |-| to denote the Euclidean norm of vectors and the induced norm of matrices. We 
use II "lip, where p G [l,C)o], denotes the Cp norm of time signals. In particular, for to G K and a 
measurable function : ]R>t^ — >• M", by we mean {J^ \(j){t)f dtY^^ for p G [1,cxd) and 
denotes the quantity ess supi>i^ |0('^)I- ^oi two constants A > 5 > we define H{6, A) := G : 
5 < \x\ < A}. We also will use B{r) := H{0, r). A continuous function p : M>o ]R>o is of class M 
if it is non-decreasing. A function 7 : ]R>o M>o is of class /C (7 G /C), if it is continuous, strictly 
increasing and zero at zero; 7 G /Cqo if in addition, 7(5) ^ 00 as s ^ 00. A function a : ]R>o — > M>o 
is of class VV if it is continuous and positive definite. We denote by to, a^o), the solutions of the 
differential equation 

x = f{t,x) (1) 

with initial conditions (to,Xo). For a function y : M x — > M we define its derivative in the 
direction {1, f{t, x)^)^ as V{t,x) '■= ^ + • This abuse of notation is reasonable because 

of ([Q). Furthermore, with an abuse of notation we will use the same definition to express the 
derivative of locally Lipschitz functions. For the latter, V{t,x) is defined everywhere except on a 
set of measure zero where the gradient of V is not defined, i.e., almost everywhere. When clear 
from the context and to simplify the notation we will also use V/(x) to define ^^^^^ . 

Definition 1 (Uniform global stability) The origin of the system is said to be uniformly globally 
stable (UGS) if there exists 7 G /Coo such that, for each (to,Xo) G M x R" each solution x(-,to,a;o) 
satisfies 

|x(t,to,Xo)| < 7(|a;o|) Vt>to. (2) 

Definition 2 (Uniform global attractivity) The origin of the system (P) is said to be uniformly glob- 
ally attractive (UGA) if for each r, a > there exists T > such that 

kol < r ^ ||a;(t,to,Xo)|| < a Vt>to + T. (3) 

Furthermore, we say that the (origin of the) system is uniformly globally asymptotically stable 
(UGAS) if it is UGS and UGA. 

The results on control design that we will present rely on the notion of uniform 5-persistency of 
excitation (U(5-PE) which is defined next for completeness and ease of reference. 

Definition 3 (see il&f ) A function ■) where t 1— > 0(t,a;) is locally integrable, is said to be uni- 
formly 5-persistently exciting (U(5-PE) with respect to Xi if for each x G ]R"\{a;i = 0} there exist 
5 > 0, T > and > s.t. Vt G M, 

rt+T 

\z-x\<6 =^ |0(r,z)|dr > /i. (4) 

□ 
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Roughly speaking this property means that the function u(t,x{t)) is persistently exciting^ (PE) 
whenever the trajectories Xi{t) are away from a 5-neighborhood of the origin. We will also make 
use of the following observations. 

Fact 1 For locally Lipschitz functions, uniformly in t, and such that 0j(t,O) = we have that if 
the product YYi=i(t>i(t,x) is U5-PE then, necessarily each function (j)i{t,x) is U5-PE. In particular, 
4>i{t, xY is U5-PE for any integer p. 

Property 1 Consider the differential equation 

= -a^f + (t){t,z), a>0 (5) 

where 4>(t,x) is U5-PE with respect to zi. Then, defining (f)j{- ,tf^,(j)f„,x) as the solution of 

X2 := co\[tf^, (pf^, Z2] and Xi := Zi, the function (f)f(t,x) := (l)f{t,tf„,(j)f^, z) is U5-PE with respect 

to Xi 

Fact 2 We have from Lemma 3] that there exist a continuous function 6^ : M>o —>■ lR>o ^"^^ 
7a G /C such that the lower bound on the integral in (jlj) holds for all X2 G B{A)\{x2 = 0} with 
T = 9Ai\x2\) and = 7A(|a:^2|)- 



2 The nonholonomic integrator: a case study 



In order to motivate our extended Matrosov's theorem (cf. Theorem and to illustrate the 
formulation of the sufficient conditions that it imposes for UGAS, we find it appropriate to deal 
with a well known control problem: the stabilization of a 3-states chain form system (see e.g. 
by smooth time-varying feedback. 

The problem of stabilization of nonholonomic systems of any dimension is well documented and 
numerous results have been proposed in the literature. We do not intend to revisit this problem in 
detail and therefore, we suggest that interested readers see for instance [T7] for a tutorial with a 
very complete literature review. See also the more recent references [THl I19j. 

Consider the problem of stabilizing the nonholonomic chained system 

Xi = u{t,x) (6a) 
X2 = u{t,x)x3 (6b) 
X3 = v(t,x) (6c) 

by smooth feedback controls u and v. In particular, we will revisit the controllers proposed in 
[13 120] and present a new proof'^ of UGAS of the closed loop. The result can be proved for any 
number of states as we will see later but for the motivation of the conditions in Theorem ^ three 
states are enough. 

^We recall that in the adaptive control literature a function t is called PE if there exist fi, T > such that 

j-t+T 

J ^{TfdT>H Vt>0. 

These controllers were originally proposed in 1151 but uniformity was proved only in i2U|. 
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The approach presented below encompasses in particular periodic time-varying feedbacks as 
considered for instance in With regard to this reference it is also interesting to observe that 
the author used Krasovski-LaSalle invariance principle to obtain a direct proof of global asymptotic 
stability. Here, we use our generalization of Matrosov's theorem which may be considered as the 
extension of the invariance principle, for general nonautonomous systems. 

We start by recalling the control laws from I2II| which are 

v{t,x) = —X3 — u(t,x)x2 (7a) 

u{t,x) = -Xi + /l(t,X2,3) , (7b) 

where ^2,3 := col[a;2, X3], used in the cited references and where h{-, ■) is a smooth function defined 
below. 

Proposition 1 Consider the system © in closed loop with (|7j). Let 

(Assumption 1) the map (^,^2,3) ^ ^(^5 2^2,3) be such that h{t,0) = 0, all its first and second 
partial derivatives are uniformly bounded by p(|x2,3|) where p(-) is a non decreasing function'' 



and, defining 





dho 

ip{t,X2) := , ho{t,X2) := h (t, 



assume that ilj{t,X2) is U5-PE with respect to X2- Then, the origin of the closed loop system is 
UGAS. □ 

The proof of this claim under a similar property to that defined by (jH) was first presented in 
PU] relying on a "cascades" argument and linear time varying systems theory. The proof that we 
propose here follows directly by constructing certain functions which allow to show that all signals 
are £p-integrable. This will motivate the conditions of our main theorem. Moreover, this proof can 
be extended for more than three states. In contrast to this, the only proof of UGAS with similar 
controls that we know for systems with n > 3 states requires the application of numerous auxiliary 
results for linear time- varying systems (see |22J and Section IXTj) . 

The general intuition to establish the proof can be explained in terms of Krasovski-LaSalle 
invariance principle. For this, let us restrict our attention to periodic feedbacks (as in [21] )■ The 
closed loop system of (jH)) with ^ is 

xi = -Xi + h{t,X2fl) (9a) 
±2 = u{t,x)x3 (9b) 
^3 = -xs + u{t, x)x2 . (9c) 

Firstly, taking the derivative of Vi{t,x) := | |a;2,3|^ we obtain that 

Vi{t, x) < -xl < . (10) 

From this inequality we obtain that ^3 — > hence, we may also admit from (jnc|) that u{t, x)x2 0. 
In addition to this, we have from ()9b|) that X2 const. This means that u{t,x) tends to a steady- 
state value which we denote by uj{t,X2). Now, since u{t,X2) is periodic in t it is reasonable to 

'^For simplicity, we will p{-) for a generic bound on any function which is uniformly bounded in t. 
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assume that it is also sufficiently rich (persistently exciting) for each X2 7^ 0. If this is the case, then 
from the conjecture that u}{t, X2)x2 necessarily the only constant value which X2 may converge 
to is zero. Finally, the convergence of xi is obtained from ()9a|l and the fact that h{t, 0) = 0. 

The clear drawback of such an argument is that it cannot be made precise for general non- 
autonomous systems since it relies on Krasovski-LaSalle invariance principle. We establish below a 
rigorous proof based on the intuiton developed so far. 

2. 1 Proof of Proposition Q] 

Firstly, UGS follows from (jlUp and the following arguments. Integrating (jlUj) from to to 00 we 
obtain that |a:2,3(t)| < |a;2,3„| for all t > t^. Technically, this inequality is valid only on the interval 
of existence of the solutions. Integrating on this window and using the fact that |x2,3(t)| is bounded 
on the maximal interval of definition we proceed to integrate the Xi-equation (jHaj) to obtain that 
< \^io \ + p(|3;2,3j) for all t > to and where p(|x2,3j) is a generic bound on /i(-,X2,3) which 
exists due to Assumption Therefore, the solutions exist for all t and actually, the origin is UGS. 
Notice also that here, p(0) = since h{t, 0) = 0. 

To prove attractivity we consider other differentiable functions which are bounded and have 
bounded derivatives on balls i3(A). Our starting point in the pursuit of these additional functions 
to combine with Vi is the observation that any terms in the derivative of subsequent auxiliary 
functions that vanish with 2:3, can be ignored since we know that^ 0:3 0. So, for example, we can 
take 

V2{t,x) := X'iu{t,x)x2 (11) 
and, defining 4>(t,x) := u(t,x)x2, we obtain that 

V2{t, x) < -(pit, xY - X30(t, x) + u{t, X)X2X3 + [X3u{t, x)]^ . 

From smoothness of m(-, ■) and Assumption [T] we obtain that its total derivative is bounded for 
bounded x, uniformly in t. In the sequel we will use the number i/ > as a generic bound on 
continuous functions over compact sets. With this under consideration, we have that 

V2{t,x) < ~(j){t,xf + u\x3\ V(t,x) G R X B{A) . 

For the sequel, we see that we can now ignore as well terms in derivatives of auxiliary functions, 
that vanish with (j){t, x) = u{t, x)x2- As a matter of fact, from (jH)) and (|7j), we now see that we can 
ignore also terms that vanish with X3, 0:3 and X2- What is more, if we were to consider the dynamics 
of the closed loop system system when x^ = and X2 is constant the Xi-equation would define the 
dynamics of a linear system with a time varying input parameterized by a constant X2, i.e, 

xi = -xi + ho{t,X2) ■■= u{t,x). 

Differentiating on both sides and owing to the fact that X2 =const, we obtain that u satisfies the 
differential equation m = — u + ^(t, 2:2) and whose solution is 

u{t,X2):= [ e-(*-"V(^,a;2)cir. (12) 
J —00 

^The precise argument that makes this rough observation hold true is contained in the upcoming Theorem ^ 
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Based on these observations, we will introduce the next function with the aim at concluding some- 
thing about the difference between Xi(-) and the steady state solution a;(-,X2). That is, we define 
our third auxiliary function as Vsit, x) := ({t, x)^, where 

C(t, x) := Xi - ho{t, X2) + uj{t, X2) , (13) 

and observe that the time derivative of V3(t,x) along the trajectories of^ 

dho ( /"* dil) \ 

C(t, x) = -C(t, x) + hit, X2,3) - Kit, X2) - ^"(^5 ^)2^3 + [j ) ^)^3 



yields 

V^{t,x) < -at,xf + v\x^\ . (14) 

To obtain this inequality we have used the smoothness of all functions. Assumption (which in 
particular implies that /i(t, ■) is locally Lipschitz, uniformly in t), and the compactness of i3(A). 

Our fourth function is introduced to be used in combination with the U5-PE property of ^/'(t, x) 
in order to infer that the only constant value that X2{-) may converge to is zero. This function is 



00 



Vi{t, x) := - y e(*"^) |cj(r, X2)x2\^ dr (15) 

which satisfies for any T > 0, 

rt+T 

Vi{t,x)<—e'^ / \uj{t,X2)x2\^ dr (16) 

and we claim that from the above and it follows that there exists a continuous, non-decreasing 
function 7(-) such that 7(0) = and for all X2 G 'B(A), 

V,{t,x)<-^{\X2\)\X2? . (17) 

This follows by appealing to Property [T] of U(5-PE functions and observing that uj{t,X2) is defined 
by the differential equation 

UJ = -UJ + ll){t,X2) ■ 

Since ip{t,X2) is U5-PE with repsect to X2, it follows that there exists /i* > such that Lj(t,X2) 
satisfies a bound like (jH). Furthermore, appealing to Fact|21and using the inequality J^*^"^ 1/(^)1 dr < 

(T//+^|/(r)|'dr)i/2 the claim follows with 7(3) := minjs, ^^^7A{sf]. 

We proceed now to evaluate the time derivative of Vi(t,x) along the trajectories of the closed 
loop system. To that end, we write 

dV4 



dx 



2 



00 

e(*-")2cu(r,X2)x2 



du , , 

-— 0:2 + cj(r,a;2) 
0x1 



dr 



dt 



\UJ\T, X2)X2\ 



/oo o 
-[e(*-^)|^(r,X2)x2r]rfr (20) 



^We emphasize that the definition of the function V3(-,-) is motivated by the behavior of the system on the 
manifold {2:3 = 0, X2 = const} however, we consider its total derivative along the trajectories of the closed loop 
system, on B{A). In other words, we do not analyze the system's dynamics only on the defined manifold. 
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and observe that due to Assumption^ all the partial derivatives in fjlSp and ()19|) which, are functions 
of {t,X2), are uniformly bounded in t by a generic bound that we denote p(|x2|). Since u{-, ■) also 
satisfies this boundedness property with p{\x\) we finally obtain using (|T3|) . that for alH G M and 
all X e B{A), 

V4{t,x) < V4{t,x) + \uj(t,X2)x2f + l^lXsl 

= V4(t, x) + I X2[Cit, x) + u{t, x) - h{t, 0:2,3) + ha{t, X2)] \^ + 1^ \xz\ 

and using (fTTj) and the fact that \hoit, X2) — h(t, X2,3)| < i^\x3\ for alH G M and x E B{A) we finally 
obtain that 

V4{t,x) < -1{\X2\) \x2f + u[C{t,xy + (j){t,x)^ + \X3\] . 

Thus, ¥4(1, x) helps us to see that for the subsequent functions we can also ignore all the terms 
vanishing with X2. It is only left to find a function whose derivative is bounded by a negative term 
of |xi| and possibly positive terms of \x2\, {x^l- For this, we introduce ¥^{1, whose total 

time derivative yields 

V5{t,x) < -x\ + 2 \h{t,X2,i)\ < -x\ + v 1X2,31 • 



Summarizing, we have that the functions 

1 



Viit.x) 

V2{t,x) 

Vz{t,x) 
Viit^x) 
V,,{t,x) 



^ [A + 3^3) 

X^u{t, X)X2 

C{t,xf see (HSl and jni 

e*-*""^^ \uj{t, X2)x2f dr 



X, 



(21) 

(22) 
(23) 

(24) 
(25) 



satisfy that Vi{t,x) < Yi{t,x) for almost all {t,x) 
(j){t, x), and 



X i3(A) with 0i(t,x) := ((^,3^), 'p2{t,x) 



Yi{t,x) 
Y2{t,x) 
Y^{t,x) 
Yiit.x) 
Y^{t,x) 



-(f)2{t,xf + U\X3\ 

-0i(t,x)^ + u Ixsl 

-7(|X2|) 1X2^ + u[(f)i{t,xf + (p2(t,xy + Ixsl ] 



- -X^ + V |X2,3| • 

To conclude (non-uniform) convergence we may appeal successively to Barbalat's Lemma ob- 
serving that all the signals are bounded and square-integrable. To conclude uniform convergence 
(and hence, UGAS), we may appeal to |^ Lemma 2] in the following manner: firstly, we observe 
that all the functions are uniformly bounded (since the system is UGS and all functions). Let 
c > be a generic constant independent of the initial conditions and let p G /Coo- Now, integrating 
yi(t,x(t)) we obtain that IIX3II2 < c|a;o|. Using this and integrating Y2{t^x{f)) and Y-^i^.xify^ we 
have that max{||0i(t, a;(t))||2 , ||02(^, x(t))||2} < c|a;o|. In a similar way, using this we obtain by 
integrating Y^it.xity) and Y5(t, x(t)) that ||a;i||2 < p(|xo|) and IIX2II2 < Pd^^ol)- So UGAS follows 
observing that max{||a;||^ , ||a;||2 < p(|xo|)} for all (t, x) G M x i3(A). ■ 

Notice that what is crucial in the argumentation above is to have that each function yfc(t,x) 
is nonpositive (which is less restricitve than requiring sign-definiteness) on the sets where all the 



9 



functions Yj with j < k vanish. Also, it is imphcitly required that all the functions Yk{-,-) vanish 
only on the set {x = 0, (pj = 0}. Notice however, that Yk{t, x) are allowed to depend on time through 
the continuous functions (f)j{t,x) and therefore they are not required to be definitely nonzero on 
the sets where Yj with j < k vanish. Finally, we remark that to conclude uniform convergence, all 
these properties are required to hold only on compact sets of the states since the system is UGS. 
This suggests that alternatively to the integral conditions evoked above, one may use directly the 
properties of the functions Vi and Fj. This is established in next section. 

3 Matrosov's theorem using a family of auxiliary functions 

Now we are ready to present our main theorem. Theorem ^ below generalizes in certain direc- 
tions, [13| Proposition 2] (see also fI^ Proposition 2]) which, as clearly shown in that reference 
is, in its turn, an extension of the "classical" Matrosov theorem ^ which combines an auxiliary 
function with a Lyapunov function that establishes UGS. See also the more recent expositions |31 
Theorem 5.5, p. 58], fOl Theorem 2.5, p. 62] and Theorem 55.3]. 

Theorem 1 Under the following assumptions the origin of the system (Q) is UGAS. 
Assumption 2 The origin of the system (0) is UGS. 

Assumption 3 There exist integers j, m > and for each A > there exist 

• a number /z > 

• locally Lipschitz continuous functions 

: M X M" ^ M, i G {!,. . ., j} 

• a (continuous) function : M x M" ^ M™, 
i G {1, . . . ,m} 

• continuous functions Fj : x M, 



such that, for almost all (t,x) G M x B{A), 



max{|Ui(t,a;)| , \(t>{t,x)\} < /i, 
V,{t,x) < F,(x,0(t,x)) 



(26) 
(27) 



Assumption 4 For each integer G {1, ■ ■ ■ 



j} we have that 



(A):{ {z,^)eB{A)xB{fi) ,Y,{z,i:) = Vz G {1, . . . , A; - 1} } 



implies 



(B): {Y,{z,^)<0}. 



Assumption 5 We have that 



(A): {(z,^)GS(A)xi3(/i) 



r,(^,^) = V^G {!,..., j}} 



implies 
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(B): {^ = 0} 



□ 

In certain cases it is also useful to remark that the condition of uniformity in the initial states 
implicit in Assumption |21 can be relaxed as follows: 

Theorem 2 If Assumption El in Theorem ^ is replaced by 

1. The origin is uniformly stable; 

2. for each Xo there exists Mo > such that \x{t,to,Xo) \ < Mo for all to and t > to] 

3. the trajectories are continuous in the initial state Xo uniformly in to 

and Assumptions EE hold then, the origin of (HJ is UGAS. □ 

A corollary of this result generalizes to time-varying systems well-known results for nonlinear cas- 
cades: 

X = fit,x,z) (28) 
z = g{t,z). (29) 



Corollary 1 If, for (j^ . (j^ . each initial condition (x^^o) produces trajectories that are bounded 
uniformly in the initial time, the functions / and g are locally Lipschitz uniformly in t, and the 
origins of ^ axid x = fit, x, 0) are UGAS then, the origin of ((211), (Ei) is UGAS. □ 



3. 1 Example: stabilization of nonholonomic systems revisited 

With aim of building intuition for the communications channels control problem which we 
present in next section and of illustrating further the utility of Theorem ^ let us come back to 
the example of the chained- form systems We now present and discuss a result for the more 
general case of n states i.e., 

xi = u{t,x) (30a) 
X2 = u{t,x)xz (30b) 

: (30c) 

Xn-l = u{t,x)Xn-l (30d) 

Xn = v{t,x) (30e) 

where n > 3. 

We will use the following smooth control laws which are the counterparts for n-states, of the 
controller ((7j): 

V{t, X) = -k'^Xn - K-Mt, x)Xn-l - K.2^n^2 " K-Z^i'^^ x)Xn-'i (31a) 

u{t,x) = —kiXi + h(t,z), z := co\[x2 , ■ ■ ■ ,Xn] ■ (31b) 
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where > for all i < n. That is, the occurrence of u{t,x) in v{t,x) alternates and the last term 
of v{t, x) is k2u{t, x)x2 if n is odd or, /c2^2 if ^ is even. Interestingly, the last n — 1 equations of the 
closed loop system has the following form which recalls us of the controllability canonical form of 
linear systems: 





X2 




is 













u 







u 



-k' 



k'^_iU 









u 





X2 








1 







(32) 



The analysis problem for this case is much more complex than for systems with three states. 
One of the main difficulties is that the high relative degree of the system from an artificial input 
w added to the second equation, to the output Xn- Notice that this relative degree in the case of 
3 states is equal to 1. This is what permitted in [20!, to use certain results from linear systems 
theory and particularly from theory of strictly positive real systems (passive systems). Therefore, 
this high relative degree is a major stumbling block in the stabilization of systems with more than 
3 states. 

An elegant solution to this structural obstacle is the time and state-dependent coordinate trans- 
formation proposed in 15^ which transforms the system (jH^ into a system whose last n — 1 equations 
have the skew-symmetric form (j35|l . As remarked also in ||22j this can also be accomplished by defin- 
ing recursively, 

(33) 



X2 


= X2 


X3 


= X3 


V3 


= -k2UX2 




^ ( 


Xi 






d f d 


Vi 




dt \du 


V 


= Vniu, X) 



/cj-iMiXj-i — kiXi, for all 3 < i < n 



(34) 



where the constants {k2, . . . , kn} are all positive and are uniquely defined, given n, and a set of 
positive gains {/cg, . . . , fc^}. This follows from the fact that the expressions for the new variables 
Xi depend linearly in u and x. Using the set of equations one can write the equivalent 

closed loop dynamics in the "skew symmetric" form 



Xi 
i2,n 



where X2,n := col[x2, . . . , x„] and 



A{u) 



-kiXi + h{t, z) =: u{t, Xi, X2,n) 

A{u{t,Xi,X2,n))x2,n 



M 
-k2U '■■ '■■ 

■•• ■•• 



(35a) 
(35b) 



u 







kji—lU kn 



(36) 
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To conclude UGAS for ()35p we could reason in the following manner: consider the argument of 
the matrix in ()35b|) along Xi(t) that is, u{t,Xi{t),X2,n) then, the system may be regarded as 
a cascaded time-varying system. Following this line of thought it is apparent that if h{-, ■) satisfies 
some appropriate boundedness and regularity properties, the main question is how to guarantee 
that the origin of the system in (j35bj) is UGAS. 

UGAS (uniformly also in xi) of (j35bj) may be established by a recursive coordinate transforma- 
tion plus output injection arguments which transforms the system into the form 



—u^ u 
—k2U —u^ ' ■ • 

■•• ■•• 















-kn-lU 



U 

— kr, 



(37) 



where K{t,C,) is uniformly square integrable along trajectories. Notice that for the particular case 
of /cj = 1 we have that the derivative of = 0.5 |^|^ yields 



V = -J2^''^' + ^^K{t,0, ^<n-l 



1=1 



Then, it can be shown that if u^* is U5-PE for any i, UGAS of (j?fj) may be concluded owing to the 
fact that K{t,C,{t)) is uniformly square integrable and the origin is already UGS. Finally, we see 
that from the properties of U5-PE functions it follows that u^* is U5-PE for any i if u is U5-PE. 
See [221 for further details. 

While the proof in |22] allows to conclude UGAS under very similar conditions than those 
imposed in it is rather complex since it appeals to a number of auxiliary results for time- 
varying systems. For instance, in the proof of the main result in [221 the system is regarded as a 
parameterized time-varying /mear system ^ = A{u{t, xi{t, X),X2,n{t, A))^ where A = col[to, Xo]. The 
theorem that we present below can actually be proved directly using Theorem ^ Let us consider 
the system ^ with 



X :- 



y 

z 



f{t,x) :-- 



A{u{t,y,z))z 



z e 



y e 



(3J 



and, imilarly to (jH}, define 



dho 
~dt 



dh 
'di 







Z'm—l 



(39) 



Then, we have the following. 

Theorem 3 If the function t i-^ fit,C) defined above is U(5-PE, the functions z ^ h{t,z) and 
^ I— >■ (f{t,C,) are locally Lipschitz uniformly in t and h{t, 0) = then the origin of (^, ()38|) is UGAS. 
Moreover, the origin is UGAS only if the control input u is U5-PE with respect to z. □ 



^Obviously the same holds with a properly weighted Lyapunov function and fc; 7^ 1. 
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A direct consequence is the following. 

Proposition 2 Consider the system ()3U|) in closed loop with ()3ip . Let 

(Assumption 6) the map {t,z) ^ h{t,z) be such that h{t,0) = 0, all its first and second partial 
derivatives be uniformly bounded by p{\z\) where p(-) is a non decreasing function 

and let the function 1 1— v'(t,0 is U(5-PE. Then, the closed loop system fjH3j) is UGAS. □ 

The proof of Theorem 01 is not presented here since it follows as a particular case of the proof 
of Theorem E] presented in next section along the lines of the proof for the case of three states. 
However, for completeness and further reference we provide the guidelines for sufficiency. This 
follows by applying directly Theorem Q with the following functions. 

Vi{t,x) := z'^Pz (40) 

where P := diag{pi, • • ■ , Pm} with := for alH G [2, . . . , m — 1], p^ = Pi '■= 1- In particular, 
this function allows to show UGS. The rest of the auxiliary functions are: 

Vi{t,x) := Zrr,-i+2-u{t,y,zf'~^ ■ z„,-i+i, i = 2,---,m (41) 
Vm+iit,x) := Cit,xy (42) 



with 



J — oo 

C(t,x) := y~h{t,0+uj{t,0 
h{t,0 ■■= h(^t, I 

Defining for i = 2 ■ ■ ■ m, ^i(t, ^ := ^^(t, 0*~^^m-j+i> 

/oo ^ 
e'-^MT,0\'dT (43) 

and finally, 

V2m+iit,x) ■=y\ (44) 

Note the similarity with the functions for the case of three states. In particular, note that here we 
need n — 2 functions as defined in PT|) and n — 2 functions as in (see also (fTTj) and (fT^ ) where 
n — 2 corresponds to the relative degree of ()35b|) . 



4 Control of communication channels 



We will address the problem of stabilizing by smooth feedback, a series of port-interconnected 
driftless systems as illustrated in Figure ^ The setting of this control problem covers that of time- 
varying smooth feedback stabilization of chained-form nonholonomic systems (cf. fr7\ I14j) and we 
will solve it by appealing to Theorem ^ 
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^ y2 




Figure 1: Communication channels. 



4-1 Problem setting and its solution 



In Figure H each block contains a bank of integrators with nonlinearities at the input and output 
of the integrator. The nonlinearities are supposed to be such that each block is passive in a specific 
sense. In particular, we assume that each block can be modeled as 



Ui = hi{xi) = Bi{xi)'^VWi{xi 



(45) 



where i E {1, . . . ,n} i/i, Ui G Xi G ]R"% -Bj(-) and VWi{-) are locally Lipschitz and the following 



bounds hold: 



Vh{xi)Bi{xi) > cj , Ci > 

\Biixi)\ < PBAl^il), PB, e AT 

Wi{xi) > ai{\xi\) , ai G /Coo 

VWi{Xi) < pwA\xi\), Pl4^, G /Coo 

\hi{xi)\ > Ki{\xi\) , Ki G VV . 



(46) 
(47) 
(48) 
(49) 
(50) 



The nonlinear integrator blocks are interconnected via static, nonlinear, time-varying "communica- 
tion channels" . In particular, the connection between blocks i and z + 1 is modeled by the nonlinear 
gain function gi which takes values in M and may depend, in general, on any of the states, time, 
and perhaps some additional states from outside of the network. This means that the input from 
the left to the ith. block, denoted and the input from the right to the ith block, denoted Ui^ri 



are 



Qi-iVi-i 
QiVi+i ■ 



The blocks are such that the input to the nonlinear integrator is given by 
We assume that the communication channel gains have the functional form 

Zi -\- gi^ait-i ■^) 

= -Zi + gi^a{t,x)+gi^},{t,x) 



9i{t,x,z) 
gi{t,x,z) = Ylgj{t,x,z) 



n-l 



(51a) 
(51b) 

(51c) 



for i < n — 1 and where the functions gi^a and gi^f, are continuous and Lipschitz in x uniformly in t. 
One interesting situation arises when all of the communication channel gains are the same, which 
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is the case when gi^a = 0, Zi{0) = 0, gi^b = 1 for i = 1, ■ ■ ■ , n — 2. In this case, every gain is given by 
gn-i- 

The control problem is to attach a system to the right of S„, and give necessary and 

sufficient conditions on the communication channel gains to guarantee that the origin for the closed- 
loop system is uniformly globally asymptotically stable. For the controller, we will use any static 
strict "first and third sector" nonlinearity cr(-), and the connection to S„ will be made with a reliable 
communication channel, e.g., (yf„ = 1. In particular, we have 



Vn+l 



s > ^ (t(s)s > 0, a(0) = 



^n+i^K+i) > p(|m„+i|), pevv 



-'n+l 



(52) 



Un+l 
Vn+l 



Vn 



With this controller architecture and functional form for the communication channel gains in- 
dicated in Figure HJ we ask the question: 

What are necessary and sufficient conditions on the communication channel gains to 
guarantee uniform asymptotic stability of the origin for the system (|731j-( f37)) ? 

The answer will be expressed in terms of the notion of uniform 5-persistency of excitation (cf. 
Definition 121). Note that in Definitional x is a constant parameter hence, the necessary and sufficient 
conditions for stability will be expressed in terms of the state x, being constant. To that end note 
that when x is constant the Zi subsystems in fl51|) are time-invariant linear systems with time- varying 
inputs. To better see this, let x = a; with x a constant vector and call z the new state of the linear 
system (j5ip in this setting. Then, it is direct to see that the zth communication channel gain in 
()51b|) satisfies (when gi^bit,x) = ) 

gi{t,X,z) = -Zi +^,,a(t,S) +5'i,a (53) 

= -Ut,x,z) + ^ (54) 
and we note that the steady-state solution of is given by 

Ui{t,x):= / e"^*"^Vi(T, ^)c?i" z G [1, . . . ,n - 1] (55) 

J —oo 

where _ 

Ut,x):=^^^^. (56) 

That is, Ui{t, x) is the steady-state value of the ith communication channel gain and correspondingly, 
the steady-state value of the gain of the first communication channel can be computed to be the 
product of all the u;j(t, x)'s for all i < n — 1. Based on these observations and the extended 
Matrosov's Theorem^ we may establish the following. 

Theorem 4 Suppose that 
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(Assumption 7) the function gifi{-, ■) is continuous, locally Lipscliitz in x uniformly in t, and 
bounded uniformly in t. The function Qi^ai', ■) is locally Lipschitz in x uniformly in t, twice 
continuously differentiable with first and second partial derivatives locally Lipschitz in x uni- 
formly in t and gi,a(t, 0) = 0. 

Then, the origin of the system is uniformly globally asymptotically stable if and only if 

the functions 



n-l 



{t, Xi,...,Xi)^ Y\_ ^) + 9j,b(t, x)) 



Vi e {l,...,n- 1} (57) 

Xi + l = ...=Xn=0 



is U6-PE with respect to Xj. □ 

Roughly speaking, the sufficient condition for UGAS is that the first communication channel gain 
be U5-PE, at least when the last n — 1 states are zero. From the structure of the gains in (j5T| and 
Fact n this implies that each of the communication channel gains is U5-PE when the last n — 1 
states are zero. This does not mean that it is required that each channel is always functioning 
but rather that each communication channel is functioning on average and in a synchronized way. 
Moreover, this average should be uniform in time. However, the average does not need to be uniform 
in the state. For example, the quality of the communication channel could possibly degrade as the 
"power" of the transmission signals, perhaps encoded by the size of the states Xi, decreases to zero. 
This idea is captured by the notion of U5-PE, in that this property roughly means for a function 
that it is PE in the usual sense (the channel work in average) but with a "degree of excitation" 
which depends on the size of the state (cf. Lemma 3]. 

Remark 1 It is worth mentioning that the system architecture above covers the so-called "skew- 
symmetric" systems considered in [T31 1221 and in Section 13.11 We may see this if we let Qi = ui 
for all i where ui is one of the two control inputs in those references (in particular, the controller 
which is required to be U5-PE in |21^), Ui = Xi for each 2 < i < n we replace Zi by^ xi and finally, 
we relate the function ^ to the function whose second derivative in [221 is required to be U5-PE 
or, to the "heat function" in □ 

4-2 Proof of Theorem^ 

We analyze the stability of the origin of (j45|) . (j5ip with state {x,z) by analyzing that of the 
following equivalent system. We consider the dynamics of (j45|) and, instead of the channel gain 
dynamics, (jHH), we consider that of the difference between the gains and their steady state solution 
(without the additional gi^b term). More precisely, let 

Ci(t,x,z) := Zi -gi^a(t,x) + uJi{t,x) , i e [1, . . . ,n - 1] (58) 

then (droping the arguments for simplicity in the notation), 

i , ~ dgi,a dgi^a . du, dui . 



^Here, the index i does not make sense because we have only one z-state, this is because all the gains cji = ui. 
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where x = co\[ Bi{giyi+i - gi-iyi-i) ] and 



dgi,a{t,x) 

dt 

diViit, x) 

dx 
duiit, x) 

at 



-^i{t,x) 
t 



(t-r) dlpi 



J dx 

iJi(t,x) - UJi(t,x) 



r, x)dT 



(60) 
(61) 
(62) 



Hence, using (\^, (jSHll-dSS) in §^ we obtain that 



dx 



[t, x)dT 



dx 



X . 



i G {l,...,n- 1}. 



(63) 



Under Assumption [7| we have that the right hand side of ()63|) is continuous in t and locally Lipschitz 
in {CiX) uniformly in t. From the fact that 5'j_a(t,0) = and 5'j^a(-,x) is continuously differentiable 
we also have that tpiit, 0) = and in view of (jHSl), so does oJiit, 0) = 0. Hence, it follows from (f^ 
that = if = and Xj = 0. 

It is left to show that the necessary and sufficient condition for the origin ((^, x) = (0, 0) of (j45p . 
(jH^ to be UGAS is that the functions in ^7\i be U5-PE with respect to Xi for alH G {1, . . . , n — 1}. 



4-2.1 Necessity 

We invoke the condition that for the origin of a system ^ = F{t,C,) with F{-, ■) locally Lipschitz 
in X uniformly in t and continuous in t to be UGAS, necessarily F{-,C,) must be U6-PE with respect 
to ^ (cf. Theorem 2]). Let F(t,^) correspond to the right hand side of (j^ . with 



c 

X 



(64) 



and consider the partition F(t,x) := col[F^(t,^); Fr^it,^)] where F^(t,^) corresponds to the vector 
whose elements correspond to the right hand side of ()63|) with zG{l,...,n — 1}. Let i be arbitrary 
in such interval, and let us consider nonzero points ^ such that C = and Xj+i = . . . = x„ = 0. For 
ease of reference let us define these points as ^ = s and define the following functions 



Pi(t,x) 



-(t-r) 



dipi 
dx 



(r, x)dT — 



dx 



(65) 
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Hence, letting (■)° denote (■) evaluated at s, we have that 



cr 



X. 



i+2 



X" 



p,{t,s)F,{t,s) 

B,{x,)\gl---9l,,]h2{x2) 
B2{x2)[-gl ■ ■ -rn-Mx,) +gl--- gl-M^s) ] 

Bi^i{xi^i)[-g°_2 ■ ■ ■gl^^hi^2{xi-2) +gi-i ■ ■ ■gl_ihi{xi 
Bi{xi)[-g°^i ■ ■ ■g°_^]hi^i{xi^i) 
B,+,{0)[-gt---g:_,Mx,) 








One can see from (lUBl) that the function 



n* 



for any i G {1, . . . , n — 1} 



Xi + i = ... = Xn=0 



(66) 



(67) 



can be factored out of F{t, s). Then, observing that for any real number a and any real vector v we 
have that \av\ < \a\ \v\ and that F{t, s) is U5-PE if and only if so is \F{t, s)\, we invoke Fact^to 
obtain that necessarily any of the functions in ()67|) is U5-PE with respect to Xj. The result follows 
using and ()51b|) to see that Q = implies that gj = Uj + gj^b. 

4-2.2 Sufficiency 



Proof of UGS: The Lyapunov function 



V^{x) ■.= Y,Wi{x,) , 



which is positive definite and proper with respect to a;, has the property that 

Vl{x) < -pilVnl) < 



(68) 



(69) 



regardless of the properties of the communication channels. So, with the guarantee of local existence 
of solutions, we have that 



\x{t)\ < -f{\xo\) yt>t 



(70) 



Technically, we only have this bound on the maximal interval of definition. But with x bounded on 
the maximal interval of definition and Assumption d it follows that 



Ut)\ < UQ\ + j{\\x\ 



(71) 



on the maximal interval of definition. Thus, solutions are defined for all time and, in fact, the origin 
is UGS. 
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Remark 2 Notice that the same conclusion follows for the origin (2;, x) = (0, 0) following similar 
arguments and using (jSlaj) . □ 



Proof of UGA (with a family of sign-indefinite Lyapunov functions): we will define 2n — 2 functions 
which may be classified in 3 groups of n — 1 functions. The first group of functions is defined as 
follows^ 

V2 := Vn ■ gn-l ■ 2/n-l (72) 

V3 ■■= Vn-i ■ gn~2 gl-1 ■ yn-2 (73) 
where '•' denotes the scalar product and for z G {4, ■ ■ ■ , n} , 

Vi := yn-i+2 ■ gn~i+l gl-i+2 " " " " Vn-i+l ■ (74) 

For clarity we recall that yn-i+2 £ and the gains are scalar functions. We proceed to compute 
some bounds for the time derivative of Vi. To that end we first notice that 

y. = Vhj{xj)Bj{xj) [gjVj+i - gj-iVj-i] , j G [2, . . . , n] . (75) 

Long but straightforward calculations, which involve the use of the bounds (j46|) - (j5(J|) . show that for 
each A > there exists z/ > such that for all (a;, Q G ,B(A)^, we have 

V2 < -Cn\gn-iyn-i? + v{\yn\ + \(y{yn)\) (76a) 

V3 < -Cn-l\gn-2gn-iyn-2\^ + I' {\yn\ + \gn-iyn-l\) (76b) 
Vi < ~Cn-i+2\gn-i+l ' ' ' gn-iyn-i+l\ 

+ V {\gn-i+2 ■ ■ ■ gn-iyn~i+2\ + |fl'n-j+3 " " " 5'n-ll/n-i+3 1 ) (76c) 

for all i G [4, . . . ,n] and where the coefficients q come from Then, using ^A.l\ and ()A.3j) 

successively we obtain that for alH G [2 . . . n — 2] , 



I I ^ ir II l/n— i— 1 I il/n— i— 1 i \n—i—2/n—i—l ~i/n— i— i ~ n—i—zin—i—L~ f^^\ 

l^i^/i+il < |[^n-i---^i+ij| \yi+i\ \yi+i\ gn-2 ■■■gi+i gi (77) 

so defining the following n — 1 functions 



\gn~i\\yn-i\ (78a) 
\gn-i+i ■ ■ ■ gn-l \ \yn-i+l\ , i G [3, . . . , ra] (78b) 



we can rewrite the inequalities in (fTUj) as 

V2 < -c„</)^_i + z/(|y„| + |(T(y„)|) (79a) 

< -Cn-l<pl_2 + ^{\yn\+<Pn-l) (79b) 

Vi < — Cn-i+2(pn~i+l + ^ {(pn-i+2 + 4>n~i+3 ) • (79c) 



^Strictly speaking we should write V2{t, x, C) := hn{xn) -gn-iit, x, (^~uj{t, x) +ga{t, x) ) • /i„_i (xn-i) and similarly 
for the rest of the functions but we prefer to drop the arguments and make the obvious abreviations to avoid a 
cumbersome notation. 
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Remark 3 We wish to emphasize the way the functions Vi to Vn defined so far, are ordered. For 
the use of Theorem^ what is important to observe is that V2 < on the set where the bound on Vi 
is zero, that is when y„ = 0. Accordingly, each of the bounds on the succeeding l^'s contain three 
essential terms: the first is a negative term of (pn-i+i, the next two correspond to a number u times 
(f)n-i+2 and 4>n-i+3 which appear squared and with sign '-' in the previous two derivatives Vi-i and 
Vi_2 respectively. This hints at the idea that one should be able to recursively show that if — > 
then, so does 0„_i hence also 0„_2, etc.^° Later, the U(5-PE assumption on the gains will be used 
essentially to imply that if 0j — * 0, necessarily Xi 0. □ 

The next group of n — 1 functions that we introduce helps to conclude on the behavior of the 
gains; more precisely to show that the communication channel gains converge to their steady state 
solution which was briefiy discussed above. To that end, let 

K+^:=C-, te{l,...,n-l}. (80) 

The aim is to bound (on compact sets of the states x and z) the total derivatives of these functions 
(i.e., along the trajectories of (jSHl)) with terms of the type —(f plus terms involving the |0i|'s defined 
in the previous group of functions and which appear with sign ' — 'in the previous bounds on V^. 

To that end, we first observe that the terms in brackets multiplying x in ()63|) are uniformly 
bounded in t by a continuous function of the norm of the state and hence, it is bounded by a 
number u > for all x G B{A). We also find it convenient to recall that 

Xi = Bigiy2 

= Bj [gjVj+i - gj-iVj^i] , J e [2, . . . , n - 2] 

Xn-l = Bn-i[gn-iyn — gn~2yn-2\ 
Xn = Bn[gn<y{yn) - gn-iyn-l] ■ 

SO we use (jA.lj) . ()A.2|1 and pHjl and the fact that all the gains gi and 'g^ and the functions Bi are 
uniformly bounded in t on compact sets i3(A) and proceed as we did for (|7Hjl to find that for all 
(x, C) e B{Af and alH G [2, ■ ■ ■ , n - 2], 



\x\ < V 



71-2 



E/,l/n-j-l , ,l/n-j+l\ , ,l/n-2 / x, , ,1/2 , , 
+ '^i-l ) +(f>2 + \yn\ + W{yn) \ + 0n-2 + 0n-l 

i=2 



So we can use now this inequality together with Assumption [7| to find a bound on the total time 
derivative of the function defined in (IHUj) along the trajectories of (jHSl)- We obtain that for all 
it,x,C) e M X S(A)2, 



n-1 



for alH G [1, . . . , n — 1] which is what we were seeking for. Notice that the positive terms above 
appear with negative signs in the bounds on the derivatives of the previous group of auxiliary 
functions. 



^°This reasoning is similar to the arguments employed in |15| to prove (non uniform) convergence for skew- 
symmetric systems. 
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Roughly speaking, from the following group of functions we will be able to get terms that allow 
us to conlude on the convergence of the states to zero provided that the 0j's converge to zero and 
that the gains are persistently exciting in the specific way we imposed. For the purposes of using 
Theorem we look for a group of functions with derivatives bounded by negative terms of Xi and 
possibly, positive terms of and which appear with negative sign in teh previous bounds. 

With this in mind, we define similarly to the function V4 in ()17j) . 



00 

t-T 



V2n-i+i{t,x) := - / e ^ |f]„_i(r,x)/i„_i(x„_i)| dr (83) 



'n-1 



, [l,...,n-l] . (84) 

Xi + l = ...=Xn=0 



Under Assumption [7| these functions are locally Li|)schitz in x uniformly in t. Furthermore, using 
Fact El and the inequality //^^ |/(t)| (ir < (T J^~^ |/(r)|^ (ir)^/^ we obtain that for each f2j(t, x) 
which is U5-PE with respect to Xi, there exists 7i G /C such that 

V2n-l+i(t,x) < --fn-i{\Xn-i\) \hn-i{Xn-i)f ■ (85) 

As a matter of fact, 7i(s) := min |s, ^g^^j^7iA(s)^|. 

On the other hand, the total time derivative of V2n~i+i(t,x) yields at the points of existence, 

dV2- 1 

V2n-i+i{t,x) = V2n-i+iit,x) + \Qn-i{r,x)hn-i{xn-i)f ^ ^— a.e. (86) 

ox 

To upperbound the last term on the right hand side of this expression on compact sets of the 
states, we use (fHT|l and the local Lipschitz property of V2n-i+i(t, x) and Assumption [3 to bound the 
gradient (on its points of definition). 

For the term |f2„_j(r, x)/i„__j(x„_j)|^ in (jSB|) we derive a bound (as before on compact sets of the 
states) involving with j < n — 1 and which appear with negative sign in the bounds on 

the previous functions' derivatives. To that end, we use ()58|) and ()51b|) to obtain a more convenient 
expression for uji and substitute it in to see that 

n-1 

/■ 12 



so that for all (t, x, () G ]Rxi3(A)^, [gj+Q ]^ < 101 • Furthermore, using once more the uniform 

boundedness in t of ^'^•(t, ■, ■) and arguing as above, we have that for any integer j G [i, . . . , n — 1], 

[9, + f[9,+i + 0+1 ]' < 9-9-+1 + '^(lOI + lO+il) • 

Using the fact that \yi\ < pBi{\xi\)PWii\xi\) (see (jlTjl and (jl^ ). it follows that for all {t,x,Q G 
M X i3(A)2, 

n—1 n—1 



j=i j=i 

Notice that in view of (j51c|) the bound above is exactly the same as 



n-1 
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so using the identities ()A.3|) involving giyi we finally obtain that for all {t^xX) € M x i3(A)^, and 
alH e [1, ... ,n - 1] 



n-1 



\VLiyi\ < V 



i2/n-i 



^7) 



Summarizing, we have from (jHBj) . ()85p and ()87|) that for almost all C) G M x i3(A)^ and all 
i e [1, ... ,n - 1], 

n-1 



V2n+i-l < -7n-i(|a;„-i|) \hn-i{Xn-i)f + ^^(^i + \yn\ + |o-(yn)| + ^1 '^^''^ ^ + 



(88) 



where the second, third and fourth term in brackets come from bounding the last term of ()8(ij) like 
we did to obtain (jH2I)- 

We are now ready to apply Theorem ^ To that end, define 



X :-- 



Xi 
^n 

Ci 

.Cn-1 



M-i 



(89) 



Further, define 9i{-) := PvKi(')P-Bi(') from (jTTj) . (jl^ and notice that in particular, 9i{0) = 0. Then, 
we have from (HHD, ^ and (jHHl) that for alH G {1, . . . , n-1} and almost all (t, X) G Mxi3(A)2 

^1 < -poft:„(|X„|) 

< -c„|$„_i|Vz/[ft„(|X„|) + ao^„(|X„|)] 

^3 < -C„-l|<l>„-2|' + Z^[|$„-l|+^^„(|X„|)] 

< -Cn-i-l\<^n-i-2{t,X)f + u{\<!>r._,.^{t,X)\ + \<^r.^i{t,X)\) 
Vn < -C2|$l(t,X)|' + I/(|<l>2(t,X)| + |<l>3(t,X)|) 



n-1 



K+. < -|X„+,|' + z/ ^„(|X„|) + aoe„(|X„|) + 5^|$,(t,X)| 



l/n-^ 



£=1 



V2n+i-l < -ln-i{\Xn-i\) \hn-i{Xn-i)f + 

V \ + o o ^„(|x„|) + |$„_,(t, x)|2/* + ^ |<i.,(t, x)|^/"-^ + |X 



n-1 



n+£| 



V^3n-2 < -7l(|Xl|)|/^l(Xl)|' + 

J. ( Q^{\X^\) + a o ^„(|X„|) + |$i(t, X)| V 5^ |$,(t, X)|^/"-^ + |X 



n-1 



n+£| 
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Letting each of the bounds above be denoted by Yk{X, X)) with k G [1, . . . , 3n — 2] we see 
that under Assumption [7| each of these functions is bounded on compact sets of the space of 
(X, \I/ = uniformly in t, i.e., Assumption 01 holds. Also, we see that each Yk{X,^{t, X)) 

is non-positive on the sets where all the previous bounds are identically zero (i.e.. Assumption |3] 
holds). Furthermore, in view of (jSO)), in particular since k G W, and since 7^ G /C we see that the 
set where \E') = is the origin, {X = 0} (i.e.. Assumption Ej) . UGAS follows. ■ 

5 Proof of Theorem □ 

To prove the theorem we first need to establish the following claims. 
Claim 1 Given 6 > 0, there exists e > such that: 

(A) : {{z,ij)en{6,A)xB{fi) k y,(z,^) = VzG{l,...,j-l}} 
implies 

(B) : {Y,{z,i^)<-e} . 

Proof. We prove the claim by contradiction. Suppose that for each integer n, there exist (2;^, ipn) € 
7-^(5, A) X B{ji) such that Fj(z„, = for all i G — 1}, and Yj{zn,ipn) > —j^. By 

compactness of H{6,A) x B{fi), the continuity of Yj{-, ■), and Assumption HI the sequence (zny'ipn) 
has an accumulation point (z*, G TC{6,A) x B{fj,) such that Yi{z^,ip*) = for all i G {1, . . . ,j}. 
By Assumption El this implies that 2;* = which contradicts the fact that G 7i(5, A). A 

Claim 2 Let £ G {2, . . . , j}, e > and a continuous function Ye -.W x R™ — R be given. Then the 
property 

(1) : (A) implies (B) where 

(A) : {{z,^)eni6,A)xBifi) & Fi(^,^) = G {!,...,£-!} } 

(B) : {r,(z,^)<-£} 
implies the property 

(2) : there exists Ki_i > such that 

(A) : { (z,^) en{6,A) X Bijj) & Yi{z,tP) = Vz G {1, 2} } 
implies that 

(B) : { Ke-iYe^iiz,ij) + Ye{z,ij) < -| }. 
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Proof. By Assumption 0] and 7^(5, A) C B{A), Property 2A implies that Yi^i{z,ilj) < 0. Therefore 
Property 2A imphes 

Ke^,Ye^i{z,^) + Ye{z,^)<Y,{z,^) VK,„i > . (90) 

Now if Yi^i{z,iIj) = then, due to Property 1, Property 2B holds for all Ke^i > whenever 
Property 2A holds. We claim further that there exists m > such that Property 2B holds whenever 
Property 2A holds and Yi_i{z, ip) > —m. Suppose not, i.e., for each integer n there exists ipn) € 
7i(5, A) X such that Y^_i(2;„, T/'n) > — ^ and 

> -| • (91) 

Then, by compactness of Tii^S, A) x B{n), continuity of Y^^i, and AssumptionHl the sequence ipn) 
has an accumulation point (z*,'?/;^,) such that Yf_i{z^^il)^) = 0. But then from Property 1 we have 
that Y£{z*,tp*) < —e. By continuity of Yi{-, ■) this contradicts when n is large and associated 
with a subsequence converging to the accumulation point. 

It now follows from the continuity of Yi and compactness of 7Y(5, A) x B{fi) that we can pick 
K£_i > large enough to satisfy 

~ e' 
—mKi_i+ max YAz,i>) < — 

then Property 2A implies Property 2B. A 

We now use these two claims to prove the theorem. According to Claim d Property 1 of Claim 
121 holds when i = j, 'e = e and Ye = Yj. An application of Claim |21 with these choices provides a 
value Kj_i such that Property 1 of Claim |21 holds when i = j — 1,'e = e/2 and = Kj^iYj^i + Yj. 
Continuing with this iteration, it follows that for each 6 > there exists e > and positive real 
numbers Ki, i = 1, . . . , j — 1 such that, for all {z, ip) G A) x i3(/i) 

Z{z,^) ■.= Y,K,Y,{z,,l,) + r,(z,^) < -— ^ . (92) 

i=l 

Next define the locally Lipschitz function : M x ^ R as 

i-i 

Wit, x) := J2 KiViit, x) + Vjit, x) . (93) 

i=l 

According to the conditions of the theorem and the discussion above, we have that, for almost all 
(t,x) G M X S(A), 

\W{t,x)\<^^(^ + Y.^K^_^ =:rj, (94) 

W{t,x) < Z{x,(l){t,x)) , (95) 
and, using (jJEl) together with (fH^ we obtain that for all {t,x) G M x 7Y(5, A), 

Zix,<Pit,x))<-^ . (96) 
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Using Assumption 121 for each r > and p > there exists A and 6 such that 

|x„|<r =^ \x{t,to,Xo)\ < A Vt>to (97) 

and 

\xih,to,Xo)\<5 =^ \xit,to,Xo)\< p yt>ti. (98) 

Let r and p generate A and 6 and then let A and 6 generate e and rj through the claims and 
definitions above. Let 

T > — . (99) 

£ 

We claim that 

|xo| <r , t > to + T =^ \x{t,to,Xo)\ < p . (100) 

Suppose not. It follows from the discussion above that x(t,to,Xo) G H{6,A) for all t G [to, to + T]. 
It then follows that, for almost all t & [to,to + T], 

W{t,x{t,to,Xo)) < . (101) 

Integrating and using we have 

< (102) 

which contradicts the choice of T in . ■ 



6 Conclusions 

In this paper we have presented a new tool for establishing uniform attractivity of the origin when 
the origin is uniformly stable. The tool involves the use of an arbitrary finite number of auxiliary 
functions whose derivatives are simultaneously zero only at the origin. This result generalizes 
Matrosov's theorem on uniform asymptotic stability of the origin for nonlinear time- varying systems. 

As in other auxiliary-functions based methods a la Lyapunov it is not possible to give a general 
criterion on how to chose the auxiliary functions. However, we have given some intuition on how to 
use our theorem by employing it to establish uniform global asymptotic stability of the origin for a 
controlled nonholonomic system. 
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A Useful identities involving the gains gi 

We single out some important and not obvious identitites involving the gains defined in 
and which are used in the proof of Theorem |3J 



By simply spelling out the definition of Qi we have that 

9i = 9i9i+i Vi G [1, . . . ,n - 2] g^-i = (jn-i On > . 

Furtheremore, using these identities one can show that for alH G [1, . . . , n — 2], 



9i 



[gn-i ■■■gi 



l/n-i ~^/n-i 
i/n-2 



n— i— 1 — 1/n— j ■'-n—i—l/n—i 



Qn-l — gn-1 ■ 

For illustration, we have the following for i = 3 and n = 6. 

1/3 1/3 1/3 
£/3 = C/3 9z 93 

1/3 /~l/3 l/3x /~l/3 1/3n 

= 93 [93 94 ) [93 9a ) 

1/3 /~l/3 1/3n /~1/3 r~l/3 l/3i 

= 93 [93 9a ) [93 [9a 95 \ 



, 1/3 1/3 l/3x 
(^3 9a 95 ) 



~l/3 ~l/3 ~l/3 

■93 -93 9a ■ 



(A.l) 



(A.2a) 
(A.2b) 



For the n—1 0's defined in (fTHj) which for convenience we index here as (pi with i G [1, . . . , n—2], 
and using the previous identities we have that 



\9i Vil 



\9n-l\ \yn-l\ 



ir i \ 1/n—i I \l/n—i i \—l+n—i/n—i 

\[9n-i ■ ■ ■ 9i\\ m m 



, l/n—i 



~ 1/n—i ~n—i— 1/n—i 
9n-2 9i 



'M-1 



(A.3a) 
(A.3b) 
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